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ABSTRACT 

The relationship between treatment levels and errors 
of estimate for a dependent variable in a behavioral science research 
experiment is typically evaluated by ari andlysis of covariance. Tiie 
same relation can be expressed by part correlation. In 
non-experimental research with individual-difference variables, an 
assumption regarding independence, as required by analysis* of 
covariance, would be appropriate in the non-experimental situation. 
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The analysis of covarianec is ofLen used correctly and Vv^ithuut 
'controversy in experimental behavioral research, where subjects are 
assigned randomly to treatments and the adjusting variable is em- 
ployed to reduce the si^^e of errors that are associated with differ- 
ences among subjects. In thu analysis, Lhe dependent variable is 
adjusted for preliminary dilferences among subjects after which the 
relation between the adjusted variable antl the treatment variable 
is evaluated. 

In a certain kind uf non-experimental research, the use of 
analysis of covariance has been controversial, if not incorrect. 
An example is a study involving the comparison of two populations 
or, more specifically, the comparison of the adjusted means of two 
samples from different populations. 

The example might be construed as involving three individual- 
difference variables: a dichotomous classification, population 
membership , and two behavioral variabl es . Relations among these 
three variables might be expressed by a variety oi correlation sta- 
Listics, depending on thL^ rc^s en rche r ' s intiM'OHl. However, in i ho 
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questionable covarianee analysis, the classification vv^as used as 
would be a sot of treatments in an experiment, one of the behaviors 1 
variables was used as would be an adjusting variable, and the other 
was used as would be a dependent variable. 

The product-moment coefficient of correlation Is sometimes 
given special names to identify formulas that may be useful in spe- 
cial circumstances. It may he called "po int-biserial" when one of 
the two variables is dichotomous and the other is not. "Phi coef- 
ficient'' is the term sometimes used when both variables are dichoto- 
mous. "Partial correlation" refers to the correlation between two 
sets of errors of estimate with one or more common predictors or 
secondary variables. Not as familiar is the "part correlation coel- 
ficient," which relates an unmodified variable and a set of errors 
of estimate. For both partial and part correlation the order of Lhe 
coefficient is given by the number of secondary variables. "Multiph 
correlation" may be defined as the zero-order correlation between a 
criterion variable and values of the criterion predicted from two or 
more other variables. 

In the experimental covariance analysis, the relation between 
treatments and differences among adjusted means has a correlation 
analog. The analog is seldom made explicit. For two treatments, 
either levels or qualities, the analog is part correlation or, more 
specifically, point-biser ial part correlation. For three or more 
levels, the analog is simply part correlation. For three or more 
qualities of treatment there is no correlation analog. 
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There is a familiar Lesl: oL' sigini'icanre for Llie x.ero-order 
producti-moment coefficient, whic:h uses either or F and is based 
on (N-2) degrees of freedom, where N is the number of pairs of 
scores. The test is also apjDljcable to the partial coefficient, 
based on (N ~ 2 - k) degrees of freedom where k is the order of 
the coefficient or the number of secondary variables. The present 
authors do not know of a test specifically applicable Co the [)arl 
correlation. However, if the unmodified variable and the secondary 
variable(s) are independent, as would be the case in an CAperiment 
where the unmodified variable would be the treatmtMit variable and 
the secondary variable would be the adjusting variable, tlieii the 
part correlation could be tested in a variance ratio as a comparison 
of treatment and error analogous to the main test of a covar lance 
analysis . 

Thus one can speak of part correlation as the correlation tanalog 
for the treatment variance or the difference between adjusted means 
in the analysis of covar iance applied to experimental data. It should 
be noted that the treatment variable(s) and the adjusting variable are 
assumed to be independent in the covariance model. *lhe operational 
guarantee of independence is the random assignment of subjects to 
treatments. The same assumption would apply to the correlaLlon analog. 
Since treatment effects and pre--experimentai differences among sub- 
jects are independent, the variability predicted from the adjusting 
variable and removed in the adjustment will not contain any treatment 
variabil ity . 



ERIC 



4 



5 



[a tli(i noii-uxpur imuntal situation niLMitionod LMrller as an cx- 
ampLu of quustionabic usage, tlic^rL* arc three individual diffcriMice 
variables: population membership and two behavioral variables. 
None of the three variables is necessarily independent of either 
of the others and there is no operational guarantee that it will be 
so» Thus the eovariance model does not, in general, fit the situa- 
tion. Either part or partial correlation might be employed. How- 
ever, neither is widely used, perhaps because there is relatively 
little interest in the questions that can be answered by these 
methods. Clearly it would not be correct to ask and try to answer 
a question concerning the effects of "treatment." However questions 
concerning prediction would be appropriate. Any one of ttiO three 
variables could conceivably be taken as the criterion, with the other 
two serving as predictors. Usually, however, the behavioral variable 
that is mistakenly used as a dependent variable is the logical choice 
as a criterion. The effectiveness ol' the joint prediction would be 
given by the multiple correlation coefficient or its square. If the 
predictive relation between population membership and criterion errors 
of estimate is, in fact, of interest to the researcher, then the par- 
tial coefficient would be a better choice than part because of the 
somewhat better prediction achieved when population membership and 
the predictor are not independent. 

Given an experiment with three or more levels of treatment, an 
analysis of eovariance would have two or more correlation analogs: 
the linear correlation between levels of treatment and errors of 



estimate for the dependent variable; the linear correlation between 
errors of estimate and a quadratic function of Levels; and so on 
for cubic and quartic functions, etc., if there are four or more 
levels of treatment. 

Given a classification of three or more qualitative categories, 
whether experimental or not, there would be no correlation analo^;s. 

[n summary, analysis of covariance, applied to an exper Inienta i 
design with two qualities or any number of levels of treatment, \u\s 
its correlation analog, part correlation. Since subjects are ran- 
domly assigned to treatments, the unmodified (treatment) variable 
and the secondary (adjusting) variable are independent. However, 
there are multivariate studies to which part, partial, and multiple 
correlation are applicabJe but analysis of covariance is not. 



